(19) 



J 



(12) 



Europdisches Patentamt 
European Patent Office 
Off ice europ6en des brevets (11) EP 0 744 705 A2 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

27.1 1 .1 996 Bulletin 1 996/48 



(51) Int. Ci.^: G06K 9/64, G06F 17/15. 
G03G 21/04 



(21) Application number: 96303561.3 

(22) Date of filing: 20.05.1996 



(84) Designated Contracting States: 
DE ES FR GB IT NL 

(30) Priority: 22.05.1995 AU PN31 00/95 

(71) Applicant: CANON KABUSHIKI KAISHA 
Tokyo (JP) 

(72) Inventors: 

• Donely,Ross Alexander 
West Ryde New South Wales 2114 Australia 
(AU) 



• Demetriou,Stamatios, 
Beecroft,New South Wales 2119 Australia, (AU) 

(74) Representative: Beresford, Keith Denis Lewis et 
al 

BERESFORD & Co. 

2-5 Warwick Court - — 

High Holbom 

London WC1R 5DJ (GB) 



(54) image detection system 



(57) An image detection system is disclosed for the 
detection of an image in an input pixel stream. An image 
is input as a input pixel stream (19) and accumulated 
and converted (112,113,114) into cells which are 
formed into cell data portions from regions of a corre- 
sponding image of the input pixel stream (19). A tem- 
plate storage ROM (15) stores at least one template 
that comprises a multiplicity of cell data entries derived 
from an desired image to be detected. A comparator 
matrix (115) is connected to the cell converter 
(112.113,114) and the tenplate ROM (15) for compar- 
ing the cell data portions with a multiplicity of cell data 
entries to derive a template detection signal (215) when 
a predetermined number of the cell data portions match 
with the multiplicity of said cell data entries. The system 
finds particular use in the prevention of fraudulent copy- 
ing of images, such as bank noted using colour laser 
copiers and printers. 
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Description 

Reld of the Invention 

5 The present invention relates to detecting input image cliaracteristics in a stream of pixel data and has particular 

application in the detection of bank notes or the like so as to prevent forgeries or copies thereof being made. 

Background Art 

TO In recent years, the availability and quality of colour reproduction systems, such as colour laser copiers, coloured 
ink jet printers and colour offset printers has increased dramatically. As a result of these increases in availability and 
quality, the incidence of forgeries being produced on such devices has also increased dramatically. Obviously, an 
increased incidence of forgeries is of great concern to the general fabric of society. Social concerns have risen to such 
an extent that the relevant authorities of various governments have seriously considered restricting or banning the use 

75 of these devices because of concerns over the increased levels of forgery. 

jhere is therefore a general need for an inexpensive form of device that can detect when a document of value is 
being copied or printed and be able to disable the printing device so as to discourage its use in the production of forger- 
ies. 

Summary of the_lnyention _ _ ^ — — - 

It is an object of the present invention to provide a means for detecting the presence of certain images in an input 
stream of pixels with the consequential side-effect that the incidence of forgeries can be lessened. 

In accordance with a first aspect of the present invention there is provided apparatus for the detection of an image 
25 in an input pixel stream, said apparatus comprising: 

(i) image input means for receiving said input pixel stream; 

(ii) cell converter means for forming cell data portions from regions of a corresponding image of said input pixel 
stream; 

30 (lii) template storage means for storing at least one template, said template comprising a multiplicity of cell data 
entries derived from the desired image to be detected; and 

(iv) comparator means for comparing said cell data portions of said cell converter means with said multiplicity of 
cell data entries to derive a template detection signal when a predetermined number of said cell data portions 
match with said multiplicity of said cell data entries. 

35 

In accordance with a second aspect of the present invention there is provided apparatus for the detection of an 
image in an input pixel stream, said apparatus comprising: 

(i) image input means for receiving said input pixel stream; 
40 (ii) cell converter means for forming cell data portions from overlapping regions of said pixel stream, said cell data 
portions being divided into a series of phases with each of said phases having cell data portions derived from non- 
overlapping regions, 

(iii) tenrplate storage means for storing at least one template, said template comprising a multiplicity of cell data 
entries derived from a desired image to be detected; and 

45 (iv) comparator means for comparing said cell data of each of said series of phases of said cell converter means 
with said multiplicity of cell data entries to derive a template detection signal when a predetermined number of said 
cell data portions match with said multiplicity of said cell data entries. 

In accordance with a third aspect of the present invention there is provided apparatus for comparing a first prede- 
50 termined array of cell data values with a second predetermined array of template data values, said apparatus compris- 
ing: 

(i) input means for inputting, a column at a time, said first predetermined array of cell data values to a comparator 
matrix means: 

55 (ii) a comparator matrix means for simultaneously determining if said column of cell data values matches with any 
of a plurality of columns of said second predetermined array of template data values and to produce a column 
matching signal designating the said matched column of said second predetermined array of template data values; 
(iii) tally array means for storing said column matching signals for a series of columns of said first predetermined 
array of cell data values, and 
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(iv) template match detection means for deriving from said stored column matching signals, a template match sig- 
nal signifying the occurrence of a match between said template and a portion of said first predetermined array of 
cell data values. 

5 In accordance with a fourth aspect of the present invention there is disclosed an image processing method com- 

prising the steps of: 

inputting image data representing an input image; 

determining whether the input image includes a first pattern extracted from a first region of a specrf ic image and 
generating a first determination result; 
10 determining whether the input image includes a second pattern extracted from In a second region of the specific 

image and generating a second determination result; and 

discriminating whether the input image includes the specific image based on the first and second determination 
results and positional information about the first and second regions. 

In accordance with a fifth aspect of the present invention there is disclosed an image processing method compris- 
75 ing the steps of: 

inputting image data r^resenting an input image; 

extracting multi-value data for each of a plurality of cells conresponding to a region of the input image; and 
discriminating whether the input image includes a specific image by comparing the extracted multi-value data 

with multi-value template data for each of a plurality of cells corresponding to a region of the specific image. 
20 In accordance with a sixth aspect of the present invention there is disclosed an image processing method compris- - 

ing the steps of: 

inputting image data r^resenting an input image: 

extracting cell data for each of a plurality of cells corresponding to a first region of the input image; and 
discriminating whether the input image includes a specific image by comparing the extracted cell data with tem- 
25 plate data for each of a plurality of cells corresponding to a second region of the ^ecific image; 

wherein the discrimination is performed by compensating a minute aberration between the first region of the 
input image and the second region of the specific image. 

Brief Description of the Drawings 

30 

A preferred embodiment of the present invention will now be described with reference to the accompanying draw- 
ings in which: 

Fig. 1 illustrates a colour copier system of the preferred embodiment; 
35 Fig. 2 illustrates the printer of Fig. 1 in more detail; 

Fig. 3 illustrates a number of different possible orientations of an image to be detected in an output image; 
Fig. 4 illustrates the template structure utilised by the pretended embodiment; 
Fig. 5 illustrates the grouping together of templates; 

Fig. 6 illustrates the phase relationship of templates utilised in the preferred embodiment; 
40 Figs. 7A to 7D illustrate the process of rotation of a template; 

Fig. 8 illustrates a numl^er of p>ossible positions that a template could be located on an image desired to be 
detected; 

Fig. 9 illustrates the alignment of a template with a rotated bank note; 

Fig. 10 illustrates the determination of a relative position vector between a pair of templates utilised in the preferred 
45 embodiment; 

Figs. 11 to 14 illustrate the process of translation of a cell of a template; 

Fig. 15 illustrates the process of rotation of a cell; 

Fig. 16 illustrates the effect on a cell of scaling a template; 

Fig. 17 illustrates the process of determining a value range; 
so Fig. 18 is a schematic block diagram of the detection module of Fig. 2; 

Figs 19 and 20 illustrate the process of gamma correction; 

Fig. 21 is a schematic block diagram of the gamma correction unit of Fig. 18; 

Fig. 22 is a schematic block diagram of the frortt end accumulator of Fig. 18; 

Fig. 23 illustrates the different template phases utilised in the preferred embodiment; 
55 Fig. 24 illustrates the data organisation of the accumulated data store of Fig. 18; 

Fig. 25 is a schematic block diagram of the phase sequencer of Fig. 18; 

Fig. 26 illustrates the data storage arrangement of the phase RAM of Rg. 18; 

Fig. 27 is a schematic block diagram of the conparator matrix of Fig. 18; 

Fig. 28 illustrates a first form of feeding columns from the phase RAM to the comparator array of Fig. 27; 
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Rg. 29 is a schematic illustration of one column of the comparator array of Fig. 27; 

Rgs. 30 to 33 illustrate the process of determining whether a template match has occun-ed; 

Rg. 34 is a schematic block diagram of a tally array of Fig. 27; 

Rg. 35 illustrates a second form of feeding columns from the phase RAM to the comparator array of Fig. 27; 
5 Rg. 36 illustrates simultaneously determining a match for a 0** and 180** rotation of a column; 

Rg. 37 illustrates the process of simultaneously determining a match for the 90° and 270** rotations of a particular 
column. 

Rg. 38 is a schematic block diagram of a comparator cell of a comparator anray of Fig. 27; 

Rg. 39 is a schematic block diagram of the detection sequencer of Fig. 18; 
10 Rg. 40 illustrates the data storage format of the template matching queue of Rg. 26; 

Fig. 41 illustrates the definition of the distance between two templates; 

Fig. 42(a) to (d) illustrates a number of possible rotations of two templates; 

Rg. 43 is a schematic block diagram of the correlator of Fig. 39; 

Rg. 44 is a schematic block diagram of the transform data unit of Fig. 39; 
15 Rg. 45 is a schematic block diagram of the write address generator of Fig. 39; and 

Rg. 46 is a schematic block diagram of the read address generator of Fig. 39. 

Detailed Description 

20 The prefer red embodiment of the present i nvention is described with reference to an a rrangement conf jguredfoL. 

incorporation in a colour laser copier system 1 . such as the Canon Colour Laser Copier sold by Canon Inc. of Japan. 
Further, the preferred ennbodiment can be readily applied to colour printers such as Models P320 and P330 also sold 
by Canon Inc. Referring now to Fig. 1 . such a colour copier system consists of a scanner 2, capable of scanning an 
input image to a very high resolution, for example 600 dots per inch (dpi). The scanned image can be fed, on a pixel by 

25 pixel basis, to a computer and control system 3 which is able to manipulate the scanned image, for exannple by provid- 
ing scaling or transforming functions. The resultant pixel image Is then fed to a printer 4, again on a pixel-by-pixel basis, 
where it is printed on a medium, such as paper. The scanned image from scanner 2, normally consists of separate col- 
our channel information for each of red, green and blue (RGB) colour portions of the scanned image, which is com- 
monly known as an additive colour format. The printer 4 generally prints out the scanned image by means of a four pass 

30 subtractive colour process. The four pass printing process normally consists of separate passes for the Cyan. Magenta, 
Yellow and Black (CMYK) portions of the scanned image. As the printer 4 operates on a four pass process, the image 
on scanner 2 is also normally scanned once to obtain the RGB colour portions which are subsequently converted to 
one of the Cyan, Magenta, Yellow and Black portions as required. 

As shown in Fig. 2, the printer 4 consists of a printer controller 6 and a print engine 7. The printer controller 6 

35 includes a colour converter 8, which takes as inputs the additive colour connponents. Red, Green, Blue (RGB) and 
derives the required subtractive colour component (CYM or K) for the required pass of the printer 4. The subtractive col- 
our components (MCYK) are supplied to the printer 4 frame-sequentially. The colour converter 8 can be implemented 
by a number of different methods, known to those skilled in the art. the actual method used not being relevant for the 
purposes of the present description. 

40 The print engine 7 includes a modulation circuit and laser driver 1 1 for aeation of the required image on an elec- 
trostatic drum for subsequent transfer to paper or other print medium. A sequence controller 12, including an internal 
central processing unit (CPU) 18. is responsible for the overall operation of the print engine 7. Additionally, there is pro- 
vided a detection module 14 which is preferably placed in, or alternatively arranged to monitor, the pixel stream 20 out- 
put from colour converter 8 to the modulation circuits 11. The detection module 14 is configured to monitor the pixel 

45 Stream 20 to detect an attempt to print out an image of a bank note or the like and to t)lank out" pixel data on an output 
19 of the detection module 14 when such an attempt is detected. The detection module 14 is designed to detect a 
numt>er of different possible bank notes or other possible candidates for unwanted duplication and includes a read-only- 
memory (ROM) 15 for storing template information derived from the different image candidates. The template ROM 15 
interacts with a detection application specific integrated circuit (ASIC) 16 which performs all the control operations of 

so detection module 1 4. 

Referring again to Rg. 1 , the scanner 2 of a colour laser copier such as Canon's P320 forms a pixel stream of data 
on a line by line basis with approximately 7,232 pixels per line and 1 1 .456 lines per scanned page. This pixel stream is 
normally generated at a rate in the vicinity of 22.5 million pixels per second. 

Turning now to Rg. 3, there is illustrated schematically a scanned image 23. This scanned image has a number of 
55 bank (monetary) notes placed at various orientations and rotations wNch are required to be detected by the detection 
module 14 of Fig. 2. Hence, the detection module 14 is designed to detect a number (one or more) of different bank 
notes 22 at different possible positions or rotations in the scanned image, in addition to detecting enlarged or reduced 
bank notes in the range of approximately 95 %-105 % of the input image size. The detection module 14. is designed to 



4 

M«innrin- <ep 0744705A2 l > 



EP 0 7m 705 A2 

detect bank notes by means of comparison of the pixel stream with a lemplate" stored in the ROM 15 so as to detect 
the occurrence of the template within the pixel stream. 

Referring now to Fig. 4, there is shown a template 25 which consists of a 9x9 array of cells 26. Each cell 26 is 
designed to be compared with a block of 128x128 pixels. As will furthe^ be desaibed hereinafter, each cell 26 contains 
5 information about the colour or brightness of the corresponding block of pixels which should be present at that portion 
of the image. 

It is necessary for the detection module 14 to detect bank notes at all possible rotations and positions. As the 
number of possible rotations and positions is extremely large, it is unrealistic to store a template for each possible rota- 
tion or position. However, if each cell contains a range of information about the colour and brightness at that position of 

w the bank note, it is not necessary to store all possible orientations. The average colour and brightness of the block of 
pixels corresponding to a single cell remains substantially the same in value for template orientations which are very 
near in position and/or rotation to an initial template. Therefore, template orientations which are very near in position 
and rotation can be grouped together so that only one template comparison operation is needed for each group. In Fig. 
5. there is shown an example of two templates 28. 29 having the same rotations but slightly different alignments. The 

75 two templates 28. 29 are said to be in the same group if their top left hand corners lie within a group area 30. Therefore, 
all corresponding translations of template 28 whose top left corner lies within the group area 30 are also considered to 
be in the same group. Additionally, all rotated tennplates whose rotation is less than 6.4 degrees and whose top left hand 
corner also lies in group area 30 are also considered to be within the same group. The use of the group area 30 sub- 
stantially reduces the number of required comparisons to be performed by the detection module 14 to a reasonable 

20 - level. The smaller the group area size 30r the more likely that a translated or rotated ternplate within the same group is- 
likely to produce similar cell values. For the purposes of the preferred embodiment, it was found that a group area 30 
which is one quarter the area of one cell 26 (Fig. 4) was suitable. 

Consider initially the simple case of detecting a template in an image without any rotatton. In order to accomplish 
this tasK the scanned page is divided into group areas and a template comparison is carried out for each group area. 

25 As mentioned above, the selected cell area is four times the group area. Therefore, to search for a template, a compar- 
ison is initially made for the group area at the top left hand corner of the scanned image page. Next, a comparison Is 
made against the group area offset half a cell to the right of the top left harxi corner, then half a cell down from the top 
left hand corner, then half a cell down and to the right of the top left hand corner. Once all these comparisons have been 
made, the equivalent of a whole cell has been covered and the process can move to the next cell position to perform 

30 the same comparisons. 

Turning now to Fig. 6, there is shown an example of this process. Five templates 32-36 are shown superimposed 
on top of one another. Template 32. as the bottom-most template, has only a small portion of Its top left hand corner 
visible and is in the top left hand corner of the image to be printed 37 and is designated to be at position (0.0). phase 
0. Template 33. the second bottom template, is offset half a cell distance to the right of template 32 and is designate 

35 to be at position (0.0). phase 2. Template 34 is positioned half a cell below template 32 and is designated to be In posi- 
tion (0.0). phase 1 . Template 35 is positioned half a cell below template 33 and is designated to be in a position (0.0). 
phase 3. Template 36. being shown as the topmost template is designated to be in a position (1 .0), phase 0. 

The four templates 32-35 have corresponding group areas which cover the cell of the top left hand corner. In the 
preferred emtKxjiment there are four phases per cell position. Of course, the number of phases per cell is dependent 

40 on the ratio between the cell area and the group area. If the group area was chosen to be a ninth of the ceil area, nine 
phases would be required. As will be seen hereinafter, this would increase the computation requirements necessary in 
the detection module 14. 

Consider now the case of rotation. A separate template of a portion of the bank note is stored for every 6.4** of rota- 
tion. This is equivalent to fourteen templates being stored in the ROM 15 (Fig. 2) for 90** of rotation. It iis only necessary 

45 to store the first 90° of rotation as the other rotations (up to 360**) can be easily obtained from the original by swapping 
the template cells around by multiples of 90*'. Referring now to Figs 7A to 7D, there is shown an original template 40 
and rotated templates 41 . 42. 43 which can be derived from the original template 40 by rotation through the simple rem- 
apping of cell address index values. 

The fourteen tennplates having rotations between 0 and 90** do not necessarily have to be In the same position on 

50 the bank note which is to be detected. The position of the template can be chosen so as to maximise its usefulness. 
Referring now to Fig. 8. there Is shown an example of multiple templates 45 having differing rotations arranged on a 
bank note 46. 

Turning now to Fig. 9 there Is shown a scanned image 50, including a rotated tank note 51. A template 52, 
designed to detect this particular rotation of the bank note 51 , is also shown. Importantly, the top and bottom edges of 
55 the template 52 are chosen to be aligned with the lines of the scanned image 50 which, of course, are not necessarily 
the same as the edges of the banknote. This substantially eases the implementation requirements for detection of the 
template 52 in a line by line pixel stream corresponding to the scanned image 50. 

Referring now to Fig. 10. preferably a pair of templates 54. 55 is stored for each possible rotation (between 0 and 
90°) of the bank note 56. This allows the detection module 14 (Fig. 2) to substantially reduce the occurrence of false 
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positive detections as each template 54. 55 can be detected and a relative position vector 58 between the pair of 
detected templates can be measured. If this relative positional distance 58 is approximately equal to the expected 
length and direction of the relative positional vector of the scanned pair of templates, then a match can be determined 
to have taken place. 

5 As discussed previously with reference to Fig. 4, a template 25 is made up of a series of cells 26. A template is 

conpared with an input image by comparison of all of its cells with cells made up from the input image. If all the cells 
match, the template is determined to have been detected. The detection module 14 works on detecting the image from 
one colour pass of the pixel stream, with the colour pass preferably being magenta. 

The information stored for each cell of a template in the ROM 15 is a pair of 4 bit numbers (MIN.MAX). To compare 

10 a cell against a block of 1 28x128 input image pixels, an average of the input image pixel values Is calculated. This aver- 
age is then rounded to four bits and if the final value is within the range (MIN.MAX), the cell is determined to have been 
matched. The range (MIN.MAX) is called a value range. The value ranges are stored in the ROM 15 and are precalcu- 
lated as will be further described herein. In general, the width of the value range (MAX-MIN) depends on the portion of 
the bank note from which the value range comes. Areas with little variation in colour (eg. plain white or plain black 

15 areas) produce narrow value ranges and areas with large variation in colour intensity (eg. a face) produce a wide value 
range. The use of value ranges allows for small changes in position, rotation and scaling of the image relative to the 
template. Further, the use of an average value for an area of pixels is chosen because of its simplicity to calculate and 
its insensitivity to small changes in position and rotation. The use of 4 bit numbers is further chosen in the preferred 
embodiment to simplify hardware requirements and reduce the necessary ROM storage space. 

20 Thexele\^ntjyraluej^ngesjfoiLe 

The bank note is scanned by a computer system at the resolution at which it is to be printed and the magenta com- 
ponent is extracted and stored in a general computer system. For each required rotation 0 (0 ^ 0 ^ 90""). the computer 
system performs the following function: 

25 1 . The bank note image is firstly rotated by an angle 0 using known computer graphics techniques for rotating 
images. 

2. The bark rote image is then low pass filtered through the convolution of the image with a square box function 
being 128x128 pixels wide. 

3. For each possible position of a template on a bank note, a "merit" value is calculated. Possible positions of tem- 
30 plates are those where all four corners of the template lie within the original image or note, except where two oppo- 
site corners lie outside the image. This is to cater for cases where the width of the k^ank note is less than the size 
of the rotated template. The merit of a template position is the product of a template's "entropy" and flatness". The 
entropy of the template is measured by calculating the sum of the differences between adjacent filtered pixel values 
in the template. Therefore the entropy is a measure of how much tie brightness varies over the whole template and 

35 helps determine how useful the template will be. Clearly, a template which is a plain white is not of great use. The 
flatness of a template is a measure of the range of values over which the template varies over each cell. 

4. For each possible pair of tenoplate positions on the bank note which do not overlap, the product of each tem- 
plate's merit is calculated. The pair with the highest product is used to determine the two positions of the template 
on the bank note. 

40 5. Once the template position has been chosen, the corresponding low pass filtered image is sampled. The sam- 
pling process involves calculating, for each cell in the template, the minimum and maximum 4 bit numbers that the 
cell can have. In order to allow the translation and rotation within a group area, in addition to scaling, the position 
of each cell is allowed to vary. 

45 Turning now to Figs. 1 1-16 the process of accounting for translation, rotation, and scaling will now be described. In 
Fig. 1 1 , there is shown the single template cell 26 of Fig. 4. As discussed previously with reference to Fig. 5, each tem- 
plate is able to undergo translational movement so long as its top left hand corner remains within the same group area. 
Therefore cell 26 can be translated to the right as shown in Fig. 1 2. It can be further translated vertically down as shown 
in Fig. 13 and vertically and to the right as shown in Fig. 14. The top left hand corner of the cell 26 therefore can map 

so out an area 220. Each of the pixels within the area 220 represents a point on which the top left hand corner of the cell 
26 could begin. 

Additionally, as noted previously a tenrplate is stored for each 6.4 degrees of rotation. As seen in Fig. 15. this 
means that the portion 220 of Fig. 14 can undergo a rotation of 6.4 degrees around a centre point 221 of the template. 
Therefore, taking into account tiie effects of translation and rotation, an area 222 will represent those possible values 
55 taken by the top left hand corner of the cell 26 under the effects of translation and rotation. 

Finally, the prefen-ed embodiment is configured to operate under the effects of scaling, including enlargement and 
reduction in the range of approximately 95 %-105 % of the original input image size. Turning now to Fig. 16. this is 
equivalent to a translation of the area 222 radially away from the centre of the template 221 to form area 223. in addition 
to the translation and scaling of the area 222 radially towards the centre of the template 221 as indicated by area 224. 
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the convex hull 225 around the areas 222-224 represents the final area tor which the top left hand edge of cell 26 can 
take. Therefore, for each cell within the template 25 of Fig. 4, the calculation of the convex hull is carried out and for 
each possible cell position, the low passed filtered image is sampled. The minimum and maximum values obtained for 
the samples then become the range of values that a cell can take. 

5 Each different possible position produces a different value for the average of the cell. As shown in Fig. 1 7. in order 

to account for further noise in the input pixel stream 20, the range of values is incremented by adding a margin to each 
side of the range. It is assumed that these calculations are carried out using eight bit pixel value quarttities, which is a 
standard format utilised in the art. The addition of the margin also allows for changes due to faded or dirty bank notes 
in addition to inaccurate catitxations. However, the choice of the size of the margin is important. If the margin is too 

10 small, the detection module 1 4 may fail to detect the bank note. and. if it is too large, the detection module 1 4 can falsely 
determine the detection of a bark note. Finally, the value range is reduced to a 4 bit numt>er by extending rt outward as 
shown m Fig t2. to the nearest 1/16 boundary. 

Referring now to Fig. 18, there is shown the detection ASIC 16 of Fig. 2 in more detail. The detection ASIC 16 
includes a njrrt>es at input/output interfaces including video data interface 81 for receiving the pixel data stream 20 from 

15 the printer contf oiiei 6 (Fig 2) and for providing the pixel data output 1 9 to the modulation and laser driving circuitry 1 1 
(Fig. 2) A pvmtei controller interface 82 is provided for interconnection with the sequence controller 12 of the print 
engine 7 (Fig 2) A FOM interlace 83 is provided to connect detection ASIC 16 to the template ROM 15 (Fig. 2) via a 
ROM intertac* umt 164 

In Table i bdow there ts shown those inputs comprising the video pixel data interface 81 . During normal operation 
20 the "print* fiignaJ mdcates that a new page of video pixel data is arriving from the printer controller 6. The pixel data 
stream 20 is &aat vn a tour pass F>rocess, so the detection ASIC 1 6 synchronises to the pixel data stream 20 of the cor- 
rect colour, which m the preferred embodiment is magenta. Each new colour is signalled by the ''top*' signal. When no 
forgery is detected, tfie pixel data is passed straight through the detection ASIC (vdo_out). If a forgery is detected, the 
vdo.out piiei data ts blanked out by the detection ASIC 16. Additionally, the vclk_out pixel data clock can also be 
25 blanked out firther preventing the output of pixel data. 



Table 1 



Video Pixel Data Interface 


Name 


Type 


Definition 


vclkjn 


input 


video data clock from video interface 


Isync 


input 


line sync from video interface 


top 


input 


top of page signal from video interface 


prnt 


input 


print signal from video interface 


vdojn (7:0) 


input 


pixel data from video interface 


vclk_out 


output 


video data clock to printer engine 


vdo_out (7:0) 


output 


pixel data to printer er>gine 



45 Referring now to Table 2, there is shown the signal definitions of the standard ROM interface 83. The ROM interface 
83 is provided for connection with up to four megabits of ROM 15 (Fig. 2). 
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Table 2 



ROM Interface 



Name 


Type 


Definition 


rom_a (18:0) 


output 


ROM address 


rom_d (15:0) 


input 


ROM data 


romO_oe_1 


output 


programmable ROM output enable 


rom1_oe_1 


output 


programmable ROM output enable 



The printer controller interface 82 includes a detection signal for notifying the sequencer controller 12 (Fig. 2) when 
a template image has been detected. Additional signals provided by the printer controller interface 82 include a config- 
uration signal for initialising the detection module 14, in addition to error signals including a IEEE standard 1149.1 - 
1990 Test Access Port Interface (TAP) 85 which can be provided for writing to and testing all internal registers of the 
detection module 14. 

The pixel data 20 is fed from the video data interface 81 to a gamnna correction unit 86. The gamma correction unit 
86 is responsible for transforming the input video pixel data using a lookup table which is loaded from the ROM 15 dur- 
ing a startup sequence, in addition to blocking output video pixel data in the event of forgery heing detected. The pur- 
pose of gamma correction is to ensure that the brightness vines utilised by the detection module 14 are evenly 
distributed to the human eye. The minimal detectable change (MDC) is the smallest amount of change in brightness 
(expressed as an eight bit number) needed for the eye to notice a difference in brightness. For an evenly distributed 
brightness, the MDC is the same for all brightness values. Referring now to Fig. 19. there is shown a graph of perceived 
brightness verses output value. The lower curve 88 shows the normal perceived brightness function of an output image. 
This curve 88 includes a lower portion 89 where perceived brightness changes very slowly and a upper portion of the 
curve 90 where the brightness changes rapidly The purpose of gamma correction is to alter the perceived brightness 
curve so that it takes the form of a curve 91 which has an evenly distributed perceived brightness. Referring now to Fig. 
20. there is shown a gamma correction mapping to translate the curve 88 to the curve 91 of Fig. 19. The gamma cor- 
rection curve includes portions 93 and 94 where there is a rapid change to counter the slow change perceived by the 
eye and a portion 95 where there is a slow change so as to counter the rapid change perceived to the eye. 

Turning now to Rg. 21 . there is shown the gamma correction unit 86 in more detail. A gamma correction RAM 97, 
designed to implement thegamma correction curve of Fig. 20. is provided and is loaded via an input 98 from the CPU 
18 during startup of the detection module 14. Input pixel data 100 is input via a latch 101 before being used as the 
address to the gamma correction RAM 97 and used to produce a gamma corrected output 102. 

The gamma correction RAM 97 stores gamma correction values as pairs of eight bit values, with each pair repre- 
senting gamma corrected values for input data that is 0 modulo 4. The address of the gamma conection RAM 97 is 
formed from the upper six bits 104 of incoming pixel data. The lower two bits 105 are used to interpolate between the 
pair of gamma corrected output values 102 by an interpolator 106 to produce final gamma corrected output value 107. 
A video output qualifier 108. which comprises a multiplexer with one input connected to ground, is provided to blank out 
the output pixel data stream 20 on the occurrence of the detection of a template which is indicated via a detection signal 
109. 

Referring again to Rg. 1 8. pixel data areas corresponding to a single cell 26 are 1 28x1 28 pixels wide and are aver- 
aged by a front end accumulator 1 1 1 and accumulated data store 112. The accumulated data store 112 stores an aver- 
age of each 64x64 block of pixels. The template cells 26 (Fig. 4) are however 128x128 pixels wide. A particular template 
cell is therefore derived from adding together four groups of accumulated data store values by a phase sequencer 1 13 
and the result is stored in a phase RAM 1 14. 

Referring now to Fig. 22, there is shown the front end accumulator 1 1 1 of Fig. 1 8 in more detail. The front end accu- 
mulator 1 1 1 is responsible for constructing each 64x64 pixel average and storage of the average in the accumulated 
data store 1 1 2 (Fig. 18). The front end accumulator includes a first stage averager 1 1 7 which adds together 64 horizon- 
tally adjacent pixels an-iving from the gamma conrection unit 86. The first stage averager 1 1 7 includes an adder 1 18. a 
latch 119 and a counter 120. 

The front end accumulator 1 1 7 reads in pixel values into the adder 1 18. The pixel values are added to a previously 
accumulated sum and stored in tie latch 1 19 thereby forming a new accumulated sum. Each time an overflow condition 
occurs, tine counter 120 is incremented (the counter 120 having been reset at the start of each set of 64 pixels). At the 
end of a 64 pixel group, the output to a second stage averager 125 is formed from the four most significant bits from tiie 
latch 1 19 and four bits from the counter 120. 



8 



EP0 744 705 A2 

Once an average of 64 pixels has been determined it is fonA/arded to a shift reg^ter 1 26 of a secx}nd stage averager 
125. Here, the average of the 64 pixels is added to a previous partial sum 127 which is fed from the accumulaied data 
store 112 (Fig. 18) and stored in a shift register 128. The two values are added by a one bit full adder 129 before being 
output 130 back to the accumulated data store 1 12 (Fig. 18) via the bus 122. The second stage averager 125 inter- 

5 leaves its access to the accumulated data store 1 1 2 with that required by the phase sequencer 1 1 3 (Fig. 1 8). A control 
unit 132 includes pixel counter 133 and line counter 134 to determine the boarders of lots of 64 pixels in addition to 
decoding logic 135 to generate the necessary control signals for the front end accumulator 1 11 in addition to the nec- 
essary address and control signals 137 for the accumulated data store 112. 

Referring again to Fig. 18. the accurrrulated data store 112 stores the partially constructed 64x64 pixel cell aver- 

10 ages. The pixel cell averages are constructed and written to the accumulated data store 1 12 by the front end accumu- 
lator 111 and read by the phase sequencer 11 3 to construct a 1 28 x 1 28 pixel cell average which is placej in the phase 
store HfiM 114. 

Turning to Fig. 23. there is shown the process of construction of 128 x 128 pixel averages from 64 x 64 pixel aver- 
ages. The 128 X 128 pixel cell average constructed will depend upon the phase of the particular cell. The construction 

15 of the 128 X 128 pixel cells 140 by the phases sequencer 113 (Fig. 18) proceeds in parallel with the construction of the 
subsequent 64 x 64 pixel cell averages 141 by front end accumulator 111. The number of 64 x 64 pixel cell averages 
141 which are required will of course be dependant on the cell size however, it will be assumed, for the purpose of dis- 
cussion of the preferred embodiment, that a maximum o1 76 pixel averages 141 are required for one line. In Fig. 24, 
there is shown the arrangement 143 of data stored in the accumulated data store 112 {Fig. 18). The required capacity 

20 of the accumulated data store Is 3 rows x 76 columns x 14 bits per data entry which gives a total of 3.1 92 bits of data. 

Referring now to Fig. 25. there Is shown the phase sequencer 1 13 of Fig. 18 in nrtore detail. The phase s^uencer 
113 performs three main tasks including: 

1 . The construction of cell data from the accumulated data store 1 1 2 by the averaging of four adjacent 64x64 pixel 
25 blocks as illustrated in Fig. 23. 

2. The generation of addresses and the storage of generated data In the phase store RAM 1 14. 

3. The generation of control and address signals for a comparator matrix 1 15 (Fig. 18). 

The phase sequencer 113 includes a phase accumulator 145 which reads in the four adjacent 64x64 average cell 

30 values from accumulated data store 112 and adds them together in an adder 146. Intermediate values are stored in a 
latch 1 47. The output of the latch 1 47 is fed back to form one of inputs to the adder 1 46, the other input being via a bidi- 
rectional bus 123 from the accumulated data store 112. Each time an overflow operation occurs In the adder 146, a 
counter 148 is incremented. An output 150 of the phase accumulator 145 is formed from the four most significant bits 
derived as a result of the addition of the four adjacent cells by the phase accumulator 1 45. This output is fed to a phase 

35 latch 152 before being forwarded to the phase RAM 1 14 (Fig. 18). 

As shown in Fig. 26, the phase RAM 1 14 is divided into four phase areas designated phase 0 to phase 3. Each 
phase area includes nine rows, corresponding to the height of the tenplate. in addition to 36 columns, corresponding 
to the number of cells in a line, and is four bits deep, with each ceil having a 4 twt value or magnitude. 

Referring again to Fig. 25. the phase latch 152 builds the data for a whole column of the phase store by effectively 

40 shifting the contents of the phase latch 1 52 by four bits to the right each time new data is received from the phase accu- 
mulator 1 45. The 36 bit data is read out and forwarded to the phase RAM 1 1 4 via a bidirectional bus 1 51 . When reading 
the data back from the phase RAM 114 only 32 bits are utilised with the top four bits being thrown away as they are 
returned to the latch 152 under the control of control logic 154 within a control unit 155. The control unit 155 also 
includes an accumulator data store address generator 156 for generating the requisite addresses for the accumulated 

45 data store 1 12 in accordance with the scheme outlined in Fig. 23. Additionally, a phase store address generator 157 Is 
provided for generating addresses for the phase RAM 114. 

As will be further discussed hereinafter, the clocking scheme of the detection module 14 can. under certain circum- 
stances, be derived from the global pixel stream of the overall copier system 1 . A glot>al dock can be provided by con- 
figuration arKi control unit 217 (Fig. 18) in accordance with a number of schemes. In the preferred emt)odiment. the 

50 required pixel clocking frequency of the detection module 1 4 is below that of the pixel stream. However, the global dock- 
ing scheme of the detection module 14. designated gclk 158 can. in some embodiments, be greate- than that of the 
input data stream. Therefore, synchronisation of the clocking speed of the input pixel data stream must occur relative 
to the global dock (gdk). This occurs via a synchroniser unit 159 which receives the control signals 138 and synchro- 
nises a start signal from the front end accumulator 111 which indicates the start of a new page, in addition to synchro- 

55 nising a ready signal from the front end accumulator 111, which indicates pixel data Is ready for reading by the phase 
sequencer 113. 

Turning now to Fig. 27 there is shown the comparator matrix 1 15 of Fig. 18 in more detail. The comparator matrix 
1 15 is an Important part of the detection module 14 as it fadlitates a high rate of comparisons in detecting image data 
from phase data and template data. The conrparator matrix 115 reads phase data 162 from the phase data ram 114 
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(Fig. 18). in addition to reading template data 163 from a ROM interface unit 164 connected to the ROM interface 83, 
both of which are supplied to a comparator array 165 (Fig. 27). The template ROM 15 has a series of templates stored 
therein corresponding to the different templates 45 (Fig. 8) for different rotations of a given inage in addition to different 
images. The results of comparisons performed by the comparator array 165 for each rotation of a template are for- 
warded to a series of tally arrays 186-189. Each tally array 186-189 determines the number of matches for a particular 
rotation of the template which is to be matched. The tally arrays 186-189 output a template detection signal 192 when 
a template match is detected. 

Referring now to Fig. 28. the general principles of operation of the comparator array 165 will now be explained in 
more detail Data for a band of cells is fed, column by column, out of the phase RAM 1 14. A band of cell data values 
consists of colunvis 228 with each column containing nine 4-bit cell values 229. The data is output from the phase RAM 
1 14 to the input bus ot the comparator array 165. A data value, eg. 229, is then compared 230 with a range of values 
for each corrparator cell 231 for a whole row 232 of comparator cells. Similarly the cell value 234 is conrpared against 
values stored m the comparator cells of row 235. A similar process is carried out for all the other entries in column 228. 

Referring now to Fig. 29. there is shown a single column 236 of comparator cell entries 231 In addition to con-e- 
sponding column of npot entries 228. 

The data value on the irput bus corresponding to entry 229 is compared at 230 to determine if it is within a range 
of values stored within the corrparator cell 231 . The output signal 239 is therefore high when the data entry 229 is within 
the range of values stored m corrparator cell 231. Similarly, the second data entry 234 is compared at 241 with a range 
of values stored within conparator cell 240 and the output 242 is "ANDed" by AND gate 243, whose other input is the 
output 239 from cefl 231 A Sffmlar process is carried out for all the other cells within a column. Therefore, a serially 
obtained output 238 w»n be active only when all the cell entries of column 236 are activated. This occurs when all the 
cell data values wttTun colunr>n 228 are within the ranges of values stored within corresponding comparator cells of col- 
umn 236. 

Referring again to Fig 28. the output of a column comparison 238 is initially latched 245 and the next column 246 
is then forwarded r» turn to the corrparator array 165. The outputs from the comparator anray 165 are forwarded to a 
first tally array 1 86 (F»o 27) Refen^ing now to Figs. 30 and 34. the tally array 1 86 (Fig. 27) includes a shift register matrix 
250 that consists of a 9x9 an^ay of shift registers 251 that retain a tally of those comparator outputs 238 (Fig. 28) which 
produced positive results. Therefore, assuming that outputs 252. 253 (Fig. 28) are activated when initial column 228 is 
fed to the conparator array 165. then shift register latch entries 255, 256 will store a high value indicating the occur- 
rence of this event 

Referring now to Fig 31 and Fig. 28. in the next clock cycle column 246 is fonwarded to tiie conparator an-ay 165 
and it is assumed that outputs 258. 259 are activated and latched by the tally anray entries 261 , 262. with the previous 
entries being shifted to row 263. 

Referring now to Fig. 32 and Fig. 28, in tiie next clock cycle data column 265 is forwarded to the comparator matrix 
1 65 and. it will be assumed, that output 266 is tiie only output line activated. This activation is latched 268 (Fig. 32) witii 
the previous activation data being shifted down one row to row 269. 

Referring now to Fig. 33. there is shown the criterion necessary for a template detection to have occun-ed. This con- 
dition occurs when a diagonal of template matches has occun-ed. This condition will occur when consecutive columr© 
of cell data 228 (Fig. 28) are matched by corresponding consecutive columns of the comparator matrix 165. It can be 
seen from Fig. 33. that in order to detect tiie diagonal, it is not necessary to store the lower left hand portion of the prior 
detection data. Hence, the shift registers required for this area can be dispensed with and a consequential saving in 
cost and layout area obtained. 

Turning now to Fig 34. there is shown the layout of a tally array 186-189 in more detail- The tally anray includes a 
shift register mati-ix 250. Detection signals 271 are fed from the conparator matrix 165 to a series of shift registers 251 . 
AND gate 272 is utilised to detect the occurrence of diagonal validation signals, outputting a detect signal 273 when all 
diagonal shift registers contain active data. 

Referring again to Fig. 27, tally an^ay 186 is designed to detect occurrences of the tenplate in a 0® rotation. The 
comparator array 165 is also designed to allow for simultaneous detection of 90, 180 and 270 degree rotation of the 
template data in the input stream. 

Referring now to Fig. 35. in order to detect 90** rotations, each column of cell data 228 is also fed into tiie conpa- 
rator array 165 from abos/e. Cell data 228 is compared against the range values contained in all of the cells 231 of col- 
umn 280. Similarly, data entry 234 is compared witfi all the cell enfies in column 281 . Also, altiiough not shown, all of 
the other entries in row 228 are conpared with values in con-esponding columns of the comparator array 165. 

The output 283 of a row 284 is obtained in an analogous manner to output 238 of Fig. 28. in that the cell outputs of 
each cell in row 284 are ANDed together (not shown in Fig. 35) to form final output 283. The otiier rows of the compa- 
rator matrix 165 also output values derived in the same manner. 

The outputs of the comparator matrix are latched into shift registers 286 which forms part of a tally an-ay 188 (Fig. 
27) The tally array 1 88 operates in a similar manner as tally an-ay 1 86, however, for tiie 90** rotation case, the opposite 
diagonal must be detected. 
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In order for the comparator matrix 1 65 to simultaneously detect the 1 80** rotation of the tennplate. an address rem- 
apping scheme is utilised. Turning now to Fig. 36» there is shown a portion of the comparator nnatrix Including the first 
column 236. The input to the conriparator matrix 1 65 from the phase RAM 114 consists of the phase data bus 1 62 which 
includes 36 bits of data divided into nine groups of four bits each. These nine 4 bit values correspond to the nine 4 bit 

f values of a single column of cell data from the phase RAM 114. The output signal 238. which corresponds to the 0** rota- 
tion case, is derived from data values tapped from the bus 162 in a first order. A signal 289, which corresponds to the 
case of 180*^ rotation, is derived in the same manner as signal 238 but for the fact that the data is tapped off the phase 
data bus 162 in the reverse order. This corresponds to testing for a 180° rotation of the data. The signal for the 180** 
rotation case 289. is fed to a tally array 188 (Fig. 39). This tally array operates in the same manner as the tally array of 

I,- Fig. 34 but for the fact that the opposite diagonal is detected. 

Referring now to Fig. 37. the 270** rotation case is formed in a similar manner to the 180** rotation case. Fig. 37 
shows a row 284 of comparator cells 231. The output signal 283 for the 90** rotation case is derived from tapping the 
phase data bus 162 in a first predetermined manner. The 270** rotation case can be derived in the same manner as the 
90' rotation case except for data being tapped off the bus 162 In the reverse order. 

If Referring now to Rg. 38 there is shown a single comparator cell 1 70 in more detail. As will be evident from the pre- 
vKxis discussion, each comparator cell 1 70 will have four bus inputs corresponding to the four possible rotations of input 
data These inputs are designated XDATAl. XDATA2. YDATA1 . YDATA2 corresponding to the 0. 180, 90 and 270** rota- 
tion cases respectively. The external outputs of the comparator array 170 are only activated when the connparator cells 
1 70 of an entire row or column, for a particular rotation, all detect valid cases of input data. Therefore, by way of exam- 

X pJe. mput line XC0MP_IN1 represents the validation signal from a previous cell for data having the same rotation. This 
stgnal is ANDed by AND gate 292 with a signal 293 whose derivation will be explained further hereinafter. The output 
182 from the AND gate 292. XCOMP_OUT1 is then forwarded to the next cell in the row. 

Scgnals XDATA2, XCOMP_IN2 and XCOMP_OUT2 con^espond to the 180** rotation case and operate in an analo- 
gous nrtanner to the 0** rotation case. Similarly, signals YDATA1. YCOMPJNI and YCOMP_OUT1 correspond to the 

^5 90** rotation case and signals YDATA2. YCOMP_IN2 and YCOMP_OLIT2 correspond to the 270** rotation case. 

In the preferred ennbodiment. the template cell data Is match^ with incoming cell data when each portion of the 
cell data is within a predetermined range. Therefore, as noted previously, a tennplate*s cell data consists of two cell val- 
ues which determined the lx)undaries of a range of values. A comparator cell 1 70 matches the input cell data when the 
cell value is within the range defined by the two range values. Therefore for each possible rotation, a range determina- 

30 tion means 1 73-1 76 is provided. A data latch 1 72 Is loaded with the upper and lower range value for the particular tem- 
plate ce8. These upper and lower values are fed to each range determination means 1 73-1 76. for each possible rotation 
within a comparator cell 170. Also fed to the range determination means 173-176 is the particular cell data (eg. 
XDATAl). Each range determination means 173-176 consists of two comparators which determine if the XDATA or 
YDATA value is within the range stored in data latch 172, outputting a signal 178. 293, 291. 290 respectively when this 

35 is the case. The template data, which comprises the set of two range values, is forwarded to the data latch 1 72 from the 
template ROM 15 (Fig. 2) by means of a series of shift registers 171. Data is shifted into the comparator matrix from 
one cell's shift register 171 to the next cell's shift register via data bus (ROM_dataJn and ROM_data_out), utilising a 
two phase clocking scheme implemented by a control tine 288. Once the template data is in position, it is forward^ to 
corresponding cell data latch 172. 

40 Referring again to Fig. 27. in order to determine if a template matches with a con-esponding Input stream, the com- 
parator array 165 is initially loaded 163 with range values from the template ROM 15. The cells correq3onding to a por- 
tion of the input image are then forwarded on the phase database 162 from the phase RAM 1 14 to the comparator array 
165 where they are tested simultaneously as hereinbefore described for matching with template data. Rotations of 0, 
90. 180 and 270 degrees are simultaneously tested by comparator matrix 165 and tally arrays 186-189 resulting in the 

45 detection signal 192 being activated when the template matches with the incoming data 162. 

In order to test other possible templates, the connparator array 1 65 can be reloaded with a corresponding new tem- 
plate from template ROM 15 and the same cell data fed from the phase RAM 1 14. 

Turning again to Fig. 18. the four detection outputs 192 from the comparator matrix 115 are fed to a detection 
sequencer 193. The detection sequencer 193 determines if an image has been detected by ar^lysing the template 

50 comparison results from the comparator matrix 11 5. As seen to Fig. 10. an image is determined to have been detected 
when a relative position vector 58 between two detected templates 55 and 54 is of an expected magnitude and direc- 
tion. 

In Rg. 39 there is shown the detection sequencer 193 in more detail. The inputs to the detection sequencer 193. 
include the detection signals 192 from the comparator matrix 115, and x-location and y-location signals 194 that are 
55 input from the phase sequencer 113 (Rg. 25). and which indicate the location of the matched template. Other inputs 
include the template ROM data 198, including the template identification data, delta (A) values and epsilon (e) values. 
This data is fed to a transform data unit 197 which is responsible for outputting transformed data in accordance with 
Table 3 below (to be described). When the detection signal 192 Is activated, the template Identification nunrtt>er, location 
and orientation of the matched template are read from the tennplate ROM 15, via the transform data unit 197. and via a 
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bus 195 are stored in a template match queue 196. Each entry in the template match queue 196 is 32 bits wide and a 
maximum of 128 entries can be stored in template match queue 196. Fig. 40 illustrates the data formal of two entries 
195 of the template match queue 196. Each of these data entries 195 contains a number of fields. A first field 199 is 
either 0 or 1 depending on which of a pair of templates it corresponds to. A second template identification 200 stores 

5 the image number to which the template belongs and is followed by a field 201 corresponding to the rotation of the tem- 
plate. A correlation factor, c is also saved for one of the two dimensions cx or cy 202. One of the conrelation factors is 
saved with each entry of the queue and is utilised in determining how much the relative vector 58 of Fig. 1 0 can change. 

Referring now to Fig. 41 . there is shown the format for measuring between two templates A and B. The values Ax 
and Ay are derived from the expected horizontal and vertical offsets respectively In Figs. 42a to 42d, there is shown the 

10 template pair definition 295 which corresponds to a zero degree rotation, in addition to a 90 degree rotation 296. a 180 
degree rotation 297 and a 270 degree rotation 298 respectively. 

Upon the detection of a template, the transform data unit 197 of the detection sequencer 193 calculates the 
required x and y position values of the detected templates mate in accordance with Table 3 below. As can be seen from 
Table 3. if the template detected is nearer to the top of the page than its mate, then the expected vertical position of its 

15 mate is calculated and stored with its own horizontal position. If the template detected is nearest the bottom of the page, 
the opposite Is done and the expected horizontal position of its mate is calculated and stored with its own vertical posi- 
tion. 
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It can be seen from the above table that both entries for the first and second half of the tenrplate will store the ver- 
tical location of the template furthest dawn the page for each rotation. Therefore, once the cun-ent line number being 
40 processed by the comparator matrix 1 1 5 is incremented to an extent sufficient to exceed by an appropriate margin the 
position stored within the template entry 195. the template entry can be removed from the template match queue 196. 

At the start of the printing of a new page, the template match queue RAM 196 is reset. This means that all the 
entries in the queue are deleted, leaving the queue empty. A pseudo "C" code description of this action is as follows: 

^ if (first = = 1 I I reset = = 1) { 

for (read addr = 0; read addr < MAXADDR+1; read addr ++) { 
so delete (read_addr); 

} 

} 

55 

When a detection signal 192 is received from the comparator matrix 1 15. an "add tenrplate" mode is entered. The 
transform data unit 1 97 is responsible for transforming its inputs 1 94. 1 98 to the correct format as shown in Fig. 40. This 
data 195 is then stored in the template match queue RAM 196 at the next available location. This can be achieved by 



12 

>lSDOCID: <EP 0744705A2_I_> 



EP0 744 705 A2 



fhe utilisation of a linked list by utilising the bits 0 to 7 of each empty entry 198 of the template match queue to be a 
pointer in a list. Therefore, detected template entries can be added to the queue by forming a link list structure. 

With most images, it will be rare for many templates to be found. However, if more than 128 tenrplate nnatches occur 
the template match queue 1 96 will be full. It has been found that, with a full queue, the best strategy is to discard entries 
on a pseudo random basis rather than the normal firsl-in/first-out basis. Therefore, a pseudo random number (PRN) 
generator 207 is provided for randomly determining a queue entry to be deleted. In situations where the queue is not 
full, a write address generator 208 determines the next queue position for writing entries into the template match queue 
196. A pseudo code representation of the "add template" mode is as follcws: 

while (1) { 

wail on (detect ! = 0); 
if (Ifull) { 

next addr = TMQ(write_addr) & Oxff; 
TMQ(writeaddr) = Xfrom(inputs); 
if (write addr = = end addr) { 



full = true; 
} else { 

writeaddr = nexiaddr; 
} else { 

TMQ(prn_addr) = Xfronn(inpuis); 

} 

} 

Turning again to Fig. 39, when not adding new entries to the template queue 196, a control unit 209 causes the 
detection sequencer 193 to otherwise continuously cycle through the template match queue 196 looking for pairs of 
templates that correlate closely enough in position to indicate that an image has been found. The control unit 209 con- 
tinuously causes a read address generator 210 to read entries from the template match queue 196. 

A correlator 214 takes two sets of data. A and B, and compares their relative identification fields in accordance with 
Table 4 below: 
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If all the correlation functions match, an image detected signal 215 is output from correlator 214 and fonvarded to 
a configuration and control unit 217 of Fig. 18. The configuration and control unit 217 (Fig. 18) in turn signals the 
gamma correction unit 86 to blank out all further data and notilies the sequencer controller 1 2 (Fig. 2) that an image has 
been detected. 

5 The control unit 209 performs the template match searching process by utilisation of two modes, firstly a "Find 

Base" mode and, secondly a "Find Mate*" mode. The Rnd Base mode includes the searching of the template matching 
queue for a suitable base template. The following pseudo "C code describes this mode; 
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{ 

load_base = 0: 

for (read addr = 0; read addr < MAXADDR+1 <S:&!load_base; 

read_addr 4- + ) { 
if (Q. first ==0&& (y_loc > Q.y_pos + Q.epi | | end) && 

valid(Q.t_id)) { 

load_base = 1; 

} 

if (Q. first = = 1 && yjoc > Q.y_pos + 3 && valid(Q.t_id)) { 
deleie(read_addr) ; 

} 

} 

if (load_base = = 1) { 

base = (Q-t id, Q.y_pos, Q.epi, Q.x_pos, Q.roi); 
loadbase = 0; 
do {find_mate( );} 

} 

} do always; 



It should be noted that the above code contains two subroutine calls, the first being "delete" and the second being 
40 "f ind_mate". The delete function can be described by the following pseudo "C" code which sets the last address bits 
and adds the entry to a linked list. 



TMQ(read_addr).l_id = Oxfff; 
if (!ftjll) { 

TMQ(end_addr).next = read_addr; 
} else { 

write_addr = read_addr; 

full = false; 

} 

end addr = read addr; 



The f ind_mate function searches for a mate of a previously found base template. This is achieved by searching 
through the queue to determine if the conditions as outlined in Table 4 have been met. A pseudo "C" code representa- 
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tion of this function or mode is as follows: 
forgery = 0; 

5 for (read_addr = 0; read_addr < MAXADDR-f 1; read_addr ++){ 

if (first = =1 && abs(y_pos - base.y_pos) < = base.epi 

&& abs (Q.x_pos - base.x_pos) < = Q.epi && Q.roi = = base. rot && 
Q.iid = = base.t_!d){ 
forgery = 1; 

} 

if (Q. first) = = 0 && Q.y_pos == base.y_j)OS && 

Q.xjpos == base.x_pos && Q.t_id == base.i_id) { 
delete(read_addr); 

} 

20 } 

} 

25 

Referring now to Fig. 43, the correlator 214 of Fig. 39 is illustrated in more detail. The correlator 214» in conjunction 
with the control unit 21 7. is responsible for implementing the methods as outlined by the atxive pseudo "C" code for the 
Find Base nrKxJe. the Rnd Mate mode and the delete function for deleting entries from the template match queue 196 
(Fig. 39). in addition to determining when an entry should be deleted from the template match queue 196. 
30 The ten^late data entry for the first candidate match is fed from the template match queue 196 (Fig. 39) to a latch 

300 via a bus 212. The second candidate entry is then fed from the template match queue 196 to the correlator 214 via 
the bus 21 2. An equality comparator 301 tests for equality of the face, rotation and orientation data from the two entries, 
the first being stored in latch 300 arKi the second forwarded via data lines 212. The output of the equality comparator 

301 is foHA^arded to AND gates 306. 309. 

35 If the first queue entry stored in the latch 300. is denoted A and the second queue entry forwarded via queue data 
bus 21 2 is denoted B, then a relational tester 303 tests whether |A - B|^cx and a relational comparator 304 tests for the 
relationship |A - B|^cy. The outputs from the equality comparator 301 , and the relational comparators 303 and 304. in 
addition to a pair indicator line 305. which indicates whether the template on data lines 212 is the first or the second of 
an expected pair, are fed together to the AND gate 306 which outputs a forgery detection signal 215 when all its inputs 

40 are high. 

A template match queue deletion signal 308. denoted deleteO. is activated when the same entry is detected twice. 
The deleteO signal 308 is derived via the AND gate 309 whose inputs are equivalent to those mentioned in the second 
conditional statement in the ak>ove pseudo "C" code describing the operation of Find Mate nrxxJe. They comprise: (i) an 
output from an equality tester 31 0 which tests for equality of y axis position location of the two templates A, B. (ii) a sec- 
45 ond equality comparator 31 1 which tests for equality of x position, and (iii) a third signal which is derived from the nega- 
tion of the signal 305 indicating the first or second pair member. The fourth signal to the AND gate 309 is the output 
from equality comparator 301 which tests for equality of the face, rotation and orientation information of the two input 
entries A. B. 

A second template matching queue deletion signal 315. denoted deletel . is activated when it is no longer possible 
50 for a tenplate within the template matching queue to match with any other template due to the fact that the current y 
address, input in the form of signal 316 is greater than the expected y address of the second matching template plus 
the ey factor. A relational comparator 317 tests for this condition with its output forming one of the inputs to an AND gate 
319. Hence, the AND gate 319 implements the conditional statement as expressed by the second conditional of the 
ak)Ove mentioned pseudo "C" code description of the Find Base mode. 
55 Referring now to Fig. 44. there is shown the transform data unit 1 97 in more detail. The transform data unit 1 97 acts 
under the control of a logic decode state machine 330 which is utilised to control various multiplexers 331 -335 in addi- 
tion to adder AN 336. As noted previously, inputs to the transform data unit 1 97 include a curr^ x and y address 1 94a, 
1 94b from the phase sequencer 1 1 3 Jn addition to Ax. Ay. ex. ey and template identification data 1 98a-1 98e. The output 
data comprises x position and y position values 195a and 195b. calculated in accordance with Table 3, in addition to an 
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e value 195c. template identification data 195d and a pair indicator 195e. Additional inputs include a pair indicator 198f 
and a detection signal 192 from the tally arrays 186-189. 

By way of example, the x position value 195a of Table 3 is generated simply through a combining multiplexer 331 
and multiplexer 332 to input x address 194a and Ax 198a to adder 336. The output is fed to multiplexer 333. Also fed to 
multiplexer 333 is x address 194a. Multiplexer 333 chooses between the two possible addresses under the control of 
decode logic 330 to output x position 195a. The logic decoder 330 is responsible for choosing the appropriate control 
signals for the multiplexers 331 . 332. 333 and the adder 336. The output signal 195b is derived in a similar manner to 
the signal 1 95a. The multiplexer 335 is utilised under the control of logic decoder 330 to decide whether the value of ex 
or cy should be output on output 1 95c. Output 1 95d is derived by adding the queue deletion signals 308. 31 5 to the tem- 
plate ID information 198e to form new template ID information 195d. 

Turning again to Fig. 39. the pseudo random number generator 207 is utilised to generate addresses into the tem- 
plate match queue RAM 196 once the queue becomes full. The pseudo random number generator 207 can be imple- 
mented using a number of known methods. For example, one form of implementation is utilising a free running 15 bit 
linear feedback shift register, with the feedback being the exclusive NOR of the two most significant bits and a two bit 
linear feed back shift register. This produces a 2^^-1 long sequence of pseudo random numbers which can be utilised 
to generate six bits of a pseudo random address and a counter for the two most significant bits of the address. 

The write address generator 208 of Rg. 39 generates the next address to write entries to when a template detect 
signal arives from the comparator matrix 115. The write address generator follows a linked list of deleted queue entries 
and on a write cycle, the location to be written is first read to extract the next write address. Therefore, the write address 
generator 208, in conjunction with the control unit 209 implements the portion of the above pseudo "C code associated 
with the add template mode as previously described. 

In Fig. 45. there is shown the write address generator 208 in more detail. The write address generator includes two 
latches 340. 341 which are utilised in following the linked list chain. The input to the first latch 340 is the last read value 
out of the template match queue 196. The address of the last entry in the linked list is latched in latch 342. An equality 
comparator 345 compares the current address node stored in latch 341 with the last address node stored in latch 342 
and produces an output 346 which is high when the two latch addresses are equal and the queue is full. A write enable 
signal 349 is output to the template match queue RAM for writing addresses to the template match queue RAM 196. 
The write enafcrfe signal 349 is derived from latch 348 under the control of a control signal 350 from the control unit 209. 
The latch 348, latches the load next signal 351 from the previous link in the link list, the load next signal 351 being 
derived from the control unit 209. 

Referring again to Fig. 39. the read address generator 210 generates the addresses for reading the queue during 
the scan to find match tenplate pairs. In Fig. 46, there is shown the read address generator 210 in more detail. The 
read address generator merely implements the two "for loops** as previously described in the pseudo "C" code outlined 
above with respect to the Find Base mode and the Find Mate nrxxJe. Hence, the read address generator 210 consists 
merely of a read latch 353 for holding the cunent read address and an incrementor 354 for incrementing the address, 
in addition to AND gate 355. The read address generator operates under the control of a clear_read and a load_read 
signal from the control unit 209. 

In the design of the detection module 14, a number of cost verses performance trade-off decisions can be made. 
The performance of the detection module 14 can be measured in terms of the number of separate images which it can 
recognise. Factors limiting this number include: 

1. The clock frequency of operation of the detection module 14. which will determine how many comparisons can 
be made for each incoming set of video pixel data. The required frequency of the clock Cf in the preferred embod- 
iment is given by the following equation: 

Cf ^eKTfm^/p{p-m)n Equationi 

2. The access time of the ROM 15 determines how many images can be fetched for comparison for each incoming 
set of video pixel data. The ROM data band width Rf of the preferred embodiment is given by the following equation: 

Rf :^nTfm'^W/2s(p-m)w Equation2 

The variables set out in the above equations are defined as follows: 

T = number of bank note templates 

/ = input video pixel data rate 

m = size of the comparator matrix in blocks = 9 

p = size of the comparator matrix in pixels = 1 1 52 

n = number of comparators in each element of the comparator matrix = 4 
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\N - width in bits of each piece of template data = 8 

s = scan line length = 5100 

tv = width in bits of the ROM interface = 16 

5 So. with the above numbers, equation (1) becomes: 

C,= 13.76x10"^ Jiln 

and equation (2) becomes: 

fl/ = 8.77x10'^7f 
giving the required access time of the ROM as: 
75 fl, = 1140/(7/) 

which also gives: 

C/ = 15.7fl^//? 

20 

The table below illustrates various operating frequency and ROM access times for differing values of 7 and 



/ 


7 


Oi 




22,5 MHz 


128 


9.92 MHz 


400 ns 


22.5 MHz 


256 


19.84 MHz 


200 ns 


22.5 MHz 


512 


39.68 MHz 


100 ns 


16.8 MHz 


128 


7.41 MHz 


530 ns 


16.8 MHz 


256 


14.82 MHz 


265 ns 



35 _ 

Ideally, the second entry in the above table, where 256 tenplates T are available is chosen. The required dock fre- 
quency will then be 19.84 MHz and the input clock frequency will be 22.5 MHz. This raises the desirable possibility that 
the fundamental clock Cf of detection nrKxjule 14 can be run directly from the clock of the overall copier system 4. if the 
frequency of the copier system 4 is 22.5 MHz. 

40 The present Invention can be used for various apparatus, such as an image scanner, a printer, a copying machine, 
a computer. Such apparatus controls process functions of the apparatus, such as an image data processing, an image 
forming processing, based on the discrimination result of the specific image. 

The above description descrSDes only one embodiment of the present invention and modifications, obvious to those 
skilled in the art. can be made thereto without departing from the scope of the invention. For example, an alternative 

A5 embodiment that merely detects the presence of a template is likely to have a restricted utility but still be partially func- 
tional. Additionally, the sizes of various cells and templates can be altered where different requirements arise. 

Claims 

50 1 . Apparatus for the detection of an image in an input pixel stream, said apparatus comprising: 

(i) image input means for receiving said input pixel stream; 

(ii) cell converter means for forming cell data portions formed from regions of a correspmding image of said 
input pixel stream: 

55 (iiO template storage means for storing at least one template, said template comprising a multiplicity of cell data 

entries derived from the desired image to be detected: and 

(iv) con^^arator means for comparing said cell data portions of said cell converter means with said multiplicity 
of celt data entries to derive a template detection signal when a predetermined number of said cell data por- 
tions match with said multiplicity of said cell data entries. 
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2. Apparatus as claimed in claim 1. wherein said multiplicity of cell data entries comprises all said cell data entries 
within said template. 

3. Apparatus as claimed in claim 1. wherein said cell data entries comprise values delimiting a range of values, and 
wherein said cell data portions must occur within said range in order to provide the desired match. 

4. Apparatus as claimed in claim 1 , wherein said comparator means simultaneously compares a column of said cell 
data portions with the whole of said cell data entries of said template to determine if any column of said template 
matches with said column of cell data portions. 

5. Apparatus as claimed in claim 4, wherein said comparator means simultaneously compares a 180 degree rotation 
of said column of cell data portions with the whole of said template to determine if any column of said template 
matches with said rotated column of cell data portions. 

6. Apparatus as claimed in claim 1. wherein said comparator means simultaneously compares a column of said cell 
data portions with the whole of said template to determine if any column off said template matches with a column 
of a 90 degree rotation of said columns of said template. 

7. Apparatus as claimed in claim 4, 5 or 6, wherein said comparator means sinnultaneously compares a column of 
said cell data portions with the whole of said template to determine if any column of said template matches with a 
column of a 270 degree rotation of said columns of said template. 

8. Apparatus as claimed in claim 1 wherein said template storage means contains multiple templates and said com- 
parator means carries out a comparison for each one of said templates. 

9. Apparatus as claimed in claim 1 wherein said comparator means loads a suljsequent template while simultane- 
ously can-ying our said comparisons of said cell data portions of said cell converter means with said multiplicity of 
cell data entries. 

10. Apparatus for the detection of an image in an input pixel stream, said apparatus comprising: 

(i) image input means for receiving said input pixel stream; 

(ii) cell converter means for forming cell data portions from overlapping regions of said pixel stream, said cell 
data portions being divided into a series of phases with each of said phases having cell data portions derived 
from rron-overlapping regions, 

(iii) template storage means for storing at least one template, said template comprising a multiplicity of cell data 
entries derived from a desired image to be detected; and 

(iv) comparator means for comparing said cell data of each of said series of phases of said cell converter 
means with said multiplicity of cell data entries to derive a tenplate detection signal when a predetermined 
number of said cell data portions match with said multiplicity of said cell data entries. 

11. Apparatus as claimed in claim 10, further comprising: 

(v) detected template storage means for storage of a plurality of template entries, with each said template entry 
including detected location data corresponding to a location of the template detected by said template detec- 
tion signal; and 

(vi) dual tenplate detection means for detecting an occurrence of two templates from the same image in said 
pixel stream. 

12. Apparatus as claimed in claim 11, wherein said dual template detection means includes distance determination 
means for determining the distance between the detected location data of said detected tenrplates. 

13. Apparatus as claimed in claim 12, wherein said distance determination means includes distance comparator 
means for determining if said distance between the detected location data is substantially the same as an expected 
predetermined distance between said detected templates. 

14. Apparatus as claimed in claim 12 or 13. wherein said distance is a vector measure having magnitude and direc- 
tional components. 
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15. Apparatus as claimed in claim 10. wherein said cell data portions include a data value derived from of a group of 
pixels, said pixels covering a two dimensional area of said image. 

16. Apparatus as claimed in daim 15. wherein said cell converter means forms multiple sets of said cell data portior^. 
5 with each set of said cell data portions being connposed from a contiguous two dimensional area of pixels in the 

input pixel stream. 

17. Apparatus for comparing a first predetermined array of cell data values with a second predetermined array of tem- 
plate data values, sad apparatus corrprising: 

10 

(i) ir^xil means for inputting, a column at a time, said first predetermined array of cell data values to a corrpa- 
ratof matrix means; 

(ii) a comparator matrix means for simultaneously determining if said column of cell data values matches with 
an^ of a plurality of columns of said second predetermined array of template data values and to produce a col- 

15 uirtn matching signal designating the said matched column of said second pr^etermined array of template 

(in] taOy array rrteans for storing said column matching signals for a series of columns of said first predeter- 
rrbn;$d may o9 eel) data values, and 

(tv) tempsate n^tch detection means for deriving from said stored column matching signals, a tenplate match 
20 &tgr>aJ cjgnify^ the occurrence of a match between said template and a portion of said first predetermined 

array cqH c&ata vatu^. 

18. Apparatus as ctaimsd cn claim 17, wherein: 

fiAtd compArafor matrix means simultaneously determines ii said column of cell data values matches with 
25 any a p^afaty Off columns of a predetermined number of rotations of said second predetermined an^ay of tem- 
plate data values artd produces a rotated column matching signal designating said matched column of said pr^e- 
termincd number c? rotations of said secorxJ predetermined array of template data values; 

sacd tally array further includes means for storing said rotated column matching signals for a series of col- 
umns of sacd first predetermined array of cell data values; and 
30 saed template nr^atch detection means further includes means to derive, from said stored rotated column 

matching stgnats. a t&rptate match signal signifying the occurrence of a match between a rotation of said template 
and a portion of sacd first predetermined array of cell data values. 

19. Apparatus as claimed in claim 17, wherein: 

35 satd comparator matrix means simultaneously determines if said column of cell data values matches with 

any of a pCurality of rows of said second predetermined array of template data values artd produces a row matching 
signal designating ^e said matched row of said second predetermined array of template data values; said appara- 
tus further conrtprtstng: 

secortd tally array means for storing said row matching signals for a series of columns of said first predeter- 
40 mined an-ay off cell data values, and 

second template match detection means for deriving from said stored row matching signals, a second tem- 
plate match signal signifying the occurrence of a match between said template and a portion of said first predeter- 
mined array of cell data values. 

45 20. Apparatus as datmed in claim 17 or 18, wherein a template data value comprises two numbers which delimit a 
range of values, and wherein a column of cell data values matches a corresponding column of said template data 
values when each of sacd cell data values is within the range delimited by said template data value. 

21. Apparatus as claimed in claim 18 wherein said rotations include sid^stantially 90. 180 and 270 degrees. 

so 

22. Apparatus as claimed in claim 1 7 wherein the number of elements of said column of cell data values is the same 
as the number of values in said column of said second predetermined array of template data values. 

23. An image processing method comprising the steps of: 
55 inputting image data representing an input image; 

determining whether the input image includes a first pattern extracted from a first region of a specific image 
and generating a first determination result; 

determining whether the input image includes a second pattern extracted from in a second region of the spe- 
cific image artd generating a second determination result; and 
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discriminating whether the input image includes the specific image based on the first and second determi- 
nation results and positional information about the first and second regions. 

24. A method according to claim 23. wherein the image data is colour component data which is used for forming a col- 
our image. 

25. A method according to claim 24, wherein the colour component data is selected one of Cyan, Magenta, Yellow and 
Black. 

26. A method according to claim 23. further comprising the step of performing density conversion on the image data 
before the determinations. 

27. A method according to claim 23, wherein said discrimination Is performed in synchronism with the input of said 
image data. 

28. A method according to claim 23, wherein said first and second regions correspond to N x M pixel block. 

29- A method according to daim 23. wherein said positional information includes distance information and direction 
information. 

30. A method according to claim 23, further comprising tie step of controlling an inr»age processing apparatus based on 
the discrimination result. 

31. An image processing method comprising the steps of : 

inputting image data representing an input Image; 

extracting multi-value data for each of a plurality of cells corresponding to a region of the input image; and 
discriminating whether the input image includes a specific innage by comparing the extracted multi-value 
data with multi-value template data for each of a plurality of cells corresponding to a region of the specific image. 

32. A method according to claim 31 . wherein the image data is colour component data which Is used for forming a col- 
our image. 

33. A method according to claim 32, wherein the colour component data is selected one of Cyan. Magenta, Yellow and 
Black. 

34. A method according to^claim 31 . wherein said discrimination is performed in synchronism with the input of same 
image data. 

35. A method according to claim 31 . wherein said multi-value tenplate data has a margin for controlling a quality of the 
discrimination. 

36. A method according to claim 31. further comprising the step of controlling an image processing apparatus based 
on the discrimination result. 

37. An image processing method conrtprising the steps of: 

inputting image data representing an input image: 

extracting cell data for each of a plurality of cells corresponding to a first region of the input image; and 
discriminating whether the input image includes a specific image by comparing the extracted cell data with 

template data for each of a plurality of cells corresponding to a second region of the specific image; 

wherein the discrimination is performed by compensating a minute aberration between the first region of the 

input image and the second region of the specific image. 

38. A method according to claim 37, wherein the image data is colour component data which Is used for forming a col- 
our image. 

39. A method according to daim 38, wherein the colour component data is selected one of Cyan, Magenta. Yellow and 
Black. 
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40. A method according to claim 37, wherein said discrimination is performed in synchronism with the input of said 
image data. 

41 . A method according to daim 37. wherein said minute aberration is smaller than a size of the cell. 

5 

42. A method according to claim 37. further comprising the step of controlling an image processing apparatus based 
on the discrimination result. 
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